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ABSTRACT 
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Competency Assessment Instrument (CCAI). The study, in confirming 
operationalization validity, found that self-report measiftg^ 
correlated only slightly with observations of students' actual 
• behaviors, while holistic impressions of competence were wholly 
consistent with the CCAI ratings. In addition, students' persuasive 
speech grades and instructors' impressions were found to correlate 
with the CCAI measure, . adding to reif^cation, or convergent validity. 
Elaboration validity analysis discovered that argumentativeness v^B^^ 
unrelated to CCAI scores. However, a relationship existed between^ 
apprehension, knowledge, an.d skill, lending credence to the idea 
that, along with judgments of behavioral appropriateness, impressions 
of communication competence are also based on perceptions of 
motivation and knowledge that manifest themselves in actual 
communication behavior. References, tables, and a figure showing the 
Communication Competence 3elf-R6port Scale items are appended. 
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VALIDITY AND RELIABILITY OF THE COMMUNICATION COMPETENCY ASSESSMENT INSTRUMENT 

■ Abstract 

This study reports validity aad reliability information on one proc|il^e use< 
to measure coniiiuni cation competence, the Communi cation Competency Assessment 
Instrument (CCAI). Conceptual ijtati on validation of the CCAI was shown «to 
exist in past research. This study, in confirming operational iziti on 
validity, found that self-reported measures cyrelatfed only slightly with 
observations of students* actual behav>Brs, while holistic impressions of 
competence were wholly consistent with the CCAI ratings. Also, students' 
persuasive speech grades and Instructors' impressions were found to, correlate 
with the CCAI measure, adding to reification, or convergent validity. 
Elaboration validity analysis discovered that argumentati veness^'was unrelated 
to CCAI scpres; However, a relationship existed between ilpprehenslon, 
^ knowledge, and skill, lending credence to the notion that, along with^ 
judgments of behavioral afJorppriateness, Impressions of communication^ 
competence are also based on perceptions of motivation and knowledge that 
manifest themselves in actual communication behavior. 
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" VALIDITY AND RELIABILITY OF THE COMMUNICATION COMPETENCY ASSESSMENT INSTRUMENT 

Conmunication conipetence Is a construct that lacks definitional 
agreement. Those who view competence as an internal state, separate from 
performance, find competence difficult to assess (e.g., Chomsky. 1965). Those 
%«^ho focus on assessment, adopt a more nar'row^ linguistic view of competence 
{e.D., Palmer, Grbot & Trosper, 1981). Current definitions within the field • 
of Communication explain competence tn terms of both cognitive and behavioral 
components {Duran & Wheeless, 1980). McCroskey (1^2), in adopting ^he 
definition of Larson, Backlund, -Redmond and Barbour (1978), enlarges this 
perspective to include cognitive, behavioral and affective components. 
Spitzberg (1983) and Rubin (1983), 1 ikewise argue that communicatj ve 
competence is comprised of knowledge, skill, and motivation dimensions. 

The perspective thlit has gained the most support thus far views 
communication competence as ah i^npression of ^one's own or another's 
communicative behavior. Jhis impression is based on perceptions of behavioral 
skills that have proved successful , judgments abcut motivation or inclination 
to use^^th€se"skVl Is, inferences about the knowledge or understanding of 
conmunication principles about these skills, and how appropriate the behavior 
appears within a context. Appropriateness may or may not entail a perception 
of accuracy or effectiveness. The entire impression of competence is based on 
actual behavior and, possibly, inferences about "the communicator's internal 
state. The goal of the communication scholar, then, is to understand how 
people leani to behave in an appropriate manner, how impressions about 
communication, competence are formed, and which sk-ills lead to perceptions of v 
competence withip various contexts. 

4 
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Research reused on the assessment of competence has attempted to*specify 
particular contents In which communication competence can be found and 
measured. These include interpersonal (Wiemann, 1977; Bochner & Kelly, 1974), 
relational (Spitzberg. 1981, 1982, 1983), social (Duran i Wheeless, 1980), 
rhetorical (Clark & Delia, 1979; Hart, Carlson, & Eadie, 1980), intejcul tur^l 
(Ruben, 1976),' organizational (Monge, Bachman,, Dillard A Elsenberg, 1982; 
Harris A Cronen, 1976; Sypher & Sypher, 1981; Walters & Snavely, 1981), mass 
media (Ploghoft, 1981) and educational (Rubin, 1982a) con tenets. . 

Determining what to examir\e within these contexts has posed 

r • 

IN. • 

methodological problems. Most of these investigation's have ^focused on the 
apprqprlateness of interpersonal and/or public speaking behaviors within the 
particular context (e.g., Allen 4 Brown, 1976; Monge, et al., 1982; Rubin, 
1982a). Others have tried to operational ize competence by focusing on 
accuracy (e.g., Krauss & Glucksberg, 1969), effectiveness (e.g.. Hale, 4980; 
Brandt, 1979), or goal, attainment (e.g., Wiemann, 1977). The problem witlj 
this latter approach is that it becomes a never-ending task to identify the . 
essence of competence, and the new constructs that are created (e.g., 
accuracy) are unique Instances 6f behavior that involve the researcher's 
perceptions of competent communication. Focusing on appropriateness, however, 
allows examination of behavior within a context; this is a more generalized, 
other-fentered approach. 

The Validation Model 
Cronbach (1971) maintains tha.t one does not validate a test, but "an 
interpretation of data arising from a specified procedure" (p. 477). The 
Communication Competency Assessment Instrument (C^AI) is one procedure that 
measures appropriateness of behavior in a specific context. As stated in the 
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American Psychological Association's (1974) Standards for Educational and 
Psychological Vests ; "No test ts valid for all purposes or in all situations 
or for all groups. of Individuals" (p. 31). The CCAI was created as a 
jjrocedore for^rovldlng valid and reliable observations of the appropriateness 
of col lege jstudents' comnuni cation behaviors within the dollege setting. ' It'^ 
was. founded on the premise tlat these Impressions of communicative competence 
are based on actual behaviors, but Inferences about the motivation to 
communicate and about -the students' knowledge of basic communication 
principles are also relevant. 

Earlier repo'rts (Rubin, 1981, 1932a) detailed the development of the ' 
Ins-trument and initial face and content validity data. An expert panel 
initially identified those specific communication skills needed by college 
students (Basse'tt, Whittington, & Staton-Spiper, 1978). Since a range of 
communication situations exist within the college setting (which had to be 

f 

Identified, analyzed, and evaluated), it, was important that this range 
represent the college experience as it relates to learning. An expert panel 
provided assurance that^hese competencies sampled the domain of comnun'l cation 
in educational contexts, thus providing content validity. In addition, 
inter-rater reliability was established for a group of nine faculty member^ 
(.92) from various fields after a four-hour training session (Rubin, 1982b),'- 
and between two raters (.97) after over a month of rating students (Rubin, 
1982a). "The high inter-rater reliability coefficients were partly due to the 
anchors provided for each of the five points used in the 19 ratingscales, 
. This initial information on face and content validity and Inter-rater 

✓ 

reliability allowed for further validation studies. Criterion- referenced 
validity is cqncerned with comparing one measurement with another; however, a 
problem existed in finding valid criterion measurements of conmunl cation 
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competence In. educational settings. Concurrent validity was examined ^nd Ipw 
(but statistically significant) correlations, were found between the CCAI anjd 
.past speaking experience (.31), grade point average (.28), number of credits 
completed (.35), and number of communication courses completed (.28). Also 
the listening portion' of the CCAI correlated (.69) with a separate listening 
test (Rubin, 1982a). ' 

Investigations concerned with predictive validity suggest that the CCAI 
Is a useful tool for predicting student teacher success (McCaleb,' 1983; Rubin 
A Feeze f, forthcoming). McCaleb, In fact, found that the CCAI demonstrated 88 
percent accur^^cy In predicting which sjtudent teachers wbj^d perform above or 
below average on communication performance ratings. Future Investigations 
will most likely explore a student's general ability to succeed In college. 

Construct validity Is concerned with testing a method or procedure 
against a theory to see what a test actually measures (Cronbach & Meehl , 
1955). This final phase of vail Idatlon usually occurs over a long period of 
time (APA, 1974) and the present Investigation 'details the Initial stages of 
this validation process. Campbell and Fiske (1959) have proposed a 
multlt^alt-multlmethod matrix of construct validity which provides Information 
on convergent and discriminant validation. The undeMylrtg assumption of this 
model Is that a test score Is a function of both the trait the test measures 
and the rrethod used to measure It. HdVvever, O'Sulllvan (1983) has re- 
conceptualized this model to^include four basic stages of validation. The 
first two deal primarily with conceptual validation, while the Jatter two are 
more concerned with empirical validation, 

- Validation Stages 
According to O'Sulllvan (1983), the first stage In validating a scale Is 
determining conceptualization validation: 'That is, on a logical level, is the 
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construct what Is being measured? One can relate the construct to existing 
literature In an attempt to establish content validity; this has been 
described elsewhere (Rubin, 1981) tfs well as earlier In this paper. One can 
also provide clear and non- redundant terminology for the Hems. The^xpert 
A panel that examined the Instrument for clarity and lack of bias and f6und the 
CCAI to be free from bias and clearly worded (Rubin, 1982bJ.l in add1t1(in to 
a previous expert panel (Rubin, 1982a), this -panel, then^valuated tHe test 
for, congruence between the construct and the task chosen to measure It, 
providing conceptualization validation fdr the CCAI. 

The^ second stage In the O'SulHvan (1983) model Is operational izatlon 
val Idatlon. If there Is only one way of measuring a construct, one.c'annot be 
sure If the scorejs are particular to the t^hnlque or If they measure a 
/general construct Identifiable by other measures; To. assess this type of 
validity, one can produce several different methods or tests. Indicate similar 
measures of the same or a similar construct, elicit different responses to the 
same stimulus set, or intercorrelate the items on the test to provide an 
ir^ernal consistency measure. Jaccard and Daly (1980) suggest comparisons 
between self-reported scales and observations^ of the same behavior. * 
As reported earlier (Rubin, 1982a) tl^ CCAI began as a 57-item instrument 
(which, can be seen as three versions of the 19-1 tem instrument). The 
coefficient alpha for the 57-item test was .83. Rather than creating three 
versions of the test, the Item from each group of three that contributed most 
to the Internal consistency of the test was retained in the final version. 
The internal consistency of the 19-1tem version was .78. M^Caleb (1983), In 
fact,, reports a much higher alpha (.89). However, different responses to the 
same. stimulus set had not yet been collected. Thus, the present study - 
attempts to discover the relationship between the CCAI and: (1) similar 
measures of the same construct, and (2) different responses to the same 

ERIC , ^ 8 
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/Stimulus set. The ul timate -pcirpose of operational izat^pn validation Is to 

' . J 

determine the beut method of measuring the construct/ 

Relflcation val Idatlon , the multl -method aspect of Campbell and Fiske's 
(1959) model, seeks to discover If different measures of the construct relate 
_ to one another. That Is, Is there a coi^relatlon with other measures of 

coromuhl cation competence or with ^ther methods of measuring the construct^ 
The examination of relflcation or convergent validity is the primary focus of 
the present investigation. The §tudy seeks to discover if alternative methods ^, 
used to assess conmuni cation competence will produce the same or similar 
results. 

- Elaboration validation , the multi-trait aspect of Campbell and Fiske's 
(1959) model dealing with discriminant validity, demands that variables or 
constructs jiot theoretical ly related to the construct not be empirical ly 
related. A previous investigation (Rubin & Henzl , 1982) found no significant ^ 
relationship between CCAI -scoreWnd cognitive complexity, however there was a 
loi correlation with a meWre of v^erbal ability. The latter association is 
interpreted as concurrent validity since measures of verbal abilHy are 
contained in the CCAI. 

Cpmmuni cation competence of students is defined as a perception of the 
appropriateness of students' behaviors in educational settings. The . 
litei^aturie on communication competence suggests that the communication 
competence of students should be somewhat distinct from concepts such as 
communication apprehension (McCroskey, 1982), argumentativeness (Infante & 
Rancep, 1982) and students' knowledge (Spitzberg, 1983; Rubin, 198„3). 
However, others^(K€ny, 1982) argue that lack of knowledge of appropriate 
behavior is essentially the reason why apprehension occurs and that both these 
constructs are manifest in actual . behavior. This study, then, examines the 
role of knowledge and apprehension in perceptions of competence. 

ER^ - • 9 '. 
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' Methods 

Forty -one student volunteers from a randomly-selected samp|e of 50 
students enrol led in an introductory course at a large midwestern university 
. compTeted two questionnaires and one behavioral analysis. From a random 
starting point, the three measures were presented to the subjects in a 
counterbalanced manner so that order effects would be ^lininated. 

The behavioral analysis was the Conmuni cation Competency AssessmMt^^ 
Instrument (Rubin, 1982b). In this procedure, students are asked. to give a 
persuasive speech, listen to a videotaped lecture, answer questions about the 
lecture,, and respond appropriately to questions about communication situations 
familiar ta.the student. The behaviors elicited by tile various "pr^obes" were 
assessed by graduate students skilled in the rating technique. Each of the 19 
behaviors was rated on a scale ranging from 5 (most app^^opriate) to 1 CI east 
appropriate)^ The total score constituted t|iis measure of behavioral 
appropriateness. 

* 

Usually the rater is alone with the student during the administration of 
the CCAI. However, to provide for a separate measure of assessing students* 
skills during this interaction, a holistic rating method wa^ used by a second 
observer to the testing process.. This holistic procedure was adapted from 
Backliind (1981) and the Massachusetts speakljfg assessment project (Mead, 
1980). Raters a>:e asked to assess the students' delivery, organization, 
content, language, listening skills, and to provide an overaVl ratins of 
communication competence. To be consistent with the CCAI, a 5-point scale was 
used, but no accompanying anchor information was provided. Thus, these raters 
observed the student proceeding, through the various portions of the CCAI and 
gave impressionistic ratings at the end of the testing period. 
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The two questionnaires students were asked to complete provided 
Information on el abaratlon' and operational izatlon validation.. McCroskey's 
(1970) 25-1teni vei;s1on of the Personal Report of Communication Apprehension 
(PRCA), a self-report measure, was used to examine the relationship between 
skill levels and motivation to communicate. Also, the Communication 
Competence Self Report (CCSR) questionnaire, a 38-item self-report measure of 
behavioral ability, was created as an alternative method of measuring 
students' skills. Statements found on the CCSR mirrored the competencies 
assessed in the CCAI. For each of the CCAI items, one statement on the CCSR 
described very ^appropriate behavior, while one described inappropriate 
behavior (similar to the "5" and T categories in the CCAI manual). Students 
were asked to determine how often (ranging fro/n "always" to "never") each of 

y 

the statements describes their own behaviors. 

The CCSR items were then subjected to coefficient alpha analysis. The 
alpha for the 38 items was .90. When the least consistent item of each 2- 
statement pair was eliminated, the coefficient alpha was .87. Statements were 
receded so that a Wgh score represented high-skill behavioral appropriateness. 
Responses to the resultant 19 items were then summed to provide a measure of 
self-reported conmunl cation competent that is consistent with the 19-item 
CCAI, an other- reported measure. Elements In the final 19-item version of the 
CCSR are found in Figure 1. . • 



Insert Figure 1 about here 

Additional information was also collected on each subject. Earlier in 
the semester, in a separate study, 34 of the students had completed the 
argut^entati veness scale (Infante and Rancer, 1982). This scale provides a 
measure of the subject's tendency to approach argumentative situations. It 
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vrfas hypothesized" that^ students d^dnstratlng high communication skills Would 
not necessarily be more arguiuentatl ve; hbwever, due to the approach-avoidance 
nature of both .argumentati veness and comrfiani cation apprehension, 
argumentativeness was Included as a construct, aTong with apprehension', that 
should be distinct from actual skill. > 

s 

»Also, each student's Instructor was asked to provide a holistic rating of 
the students' skills in four areas: public speaking, human relations, 
classroom management, and overall communication skills. The first three of 
these areas were employed since the 19 Items jn the CCAI could be used as 

. descriptors, to focus the Instructor on particular items to assess. For 
example, the classroom management area was defined as the student's ability to 
asi'. and answer questions, to understand assignments, to sunmarize Ins^tructions 
for assignments, to distinguish facts from opinions, etc. The fourth area was 
used as a general assessment of communication skill. Instructors also 
provided, at a later date, students' examination scores (as a measure of 

•knowledge) and grades given to their persuasive speeches (the speeches were 
given approximately two weeks after the data collection period). Final course 
grades were not collected since grading procedures were neither standardized 
nor uniform and students were allowed to earn extra credit for non-performance 
activities (e.g., research participation). 

Results 

Conceptualization validation of the communication competence construct, 
as measured by the Communication Competency Assessment Instrument, was 
reported earlier in this gaper and elsewhere (Rubin, 1981)'. This section, 
therefore, wi^H focus on the operational ization, reification and el<»t)oration 
validity of the CCAI as a pr6c€dure for measuring communication competence. 

12 
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Operational Izatlon 
The first set of analyses examined the operational Izatlon of the, 
coamunl cation competence construct. Jn order to discover If dlffererlt 
responses on the same iet of st1mull\ould produce Identical or similar 
'results, the scores produced by holhtic Impression during the administration 
of the CCAI were compared to the CCAI scores themselves. 

As can be seen In Tables 1 and 2, the Pearson correlation between the 
CCAI and the holistic Impression correlation was .75 (£ < .001); the. holistic 
public speaking Item correlated at .62 (£ < .001) with the first six Items of 
the CCAI (those Items pertaVliing to the extemporaneous persuasive speech). 
Thiis, it appears that different measures^-of the same stimuli produce 
consistent results. However, with the reported degree of Inter- rater 
reliability ach^i^ved with the CCAI, one. ^ou Id exert caution 1nftil?lat1n^^ 
holistic resfjSnse set since the^hollstlc rating has jto anchor points for the 
evaluation. Also, It would appear unnecessary to cons1der"fi^45.t1c rating 
since the time of test administration would remain the same using a holistic 
or an anchijred form of measurement The anchors serve to Increase inter-rater 
reltablllty.. , ^ , 



Insert Tables 1 « 2 aoout here 



^ The second set of analyses considered similar measures of the same 
construct to examine the method of obtaining the judgment of competence. As 
reported earlier In this paper, the 19-1 tern self-report version (CCSR) of the 
CCAI was internally consistent (alpha « .87). Alpha levels, however, do not 
indicate if one instrument is more or less valid than another. As Table 1 
indicates, the corr'elation between the CCAI and the CCSR was ,30 (p < .05). 
Table 3 examines each of the 19 items, showing a low level of correlation 
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between 'the self- and other-report measures. In fact, only two of the 19 
items correlated significantly. Students seemed to have a somewhat accurate 
view of their ability to express and defend a point of view, but a somewhat 
inaccurate view of their self- introduction behaviors. 



Insert Table 3 about here 

I 

This finding is not surprising. The two self-report measures used in 
this study (PRCA and CCSR) did show a high degree of correlation (-.62, 
p < .001) indicating something about the nature of self-report vs. other- 
report measures. Since the CCAI is used to assess skill levels perceived by 
others (professors, peers, etc.), the other-report measure .was most valid for 
this specific purpose. 

' Reifi cation • ^~ . 

Reificatipn deals essentially with convergent validity. That is, do 
different measures of tht same cbnstruct relate to one another? Campbell and 
Fiske (1959) refer to this as W multi-method aspect of their model. To 
establish convergent validity, other measures of communication competence 
should correlate with the procedure in question. 

Judgments formed by the students' Instructors. were used as different 

It 

measures of the construct. The overall instructor impression (created by 
summing across the four areas) was found to be internal ly consistent 
(alpha = .90). As the data in Tables 1 and 2 indicate, instructor impression 
correlated with the CCAI at .65 (£ < .001), while the instructor's perception 
of the students' public speaking abilities correlated with with speech section 
of the CCAI at .52 (£ < .001). 
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To- examine the first relationship in more depth, the instructors' overall 
Impression scores were split at the mean, forming two groups, skilled and 
linskllled." The'roean CCAI scores of the skilled grpup (i « 70.36) and 
unskil led group (M « 59.94) differed significantly (t(39) = 3.86,£ < .001). 
A similar relationship occurred when overal 1 holistic ratings were split at 
the mean into skilled (M « 71.00) and unskilled (M « 61.26) .groups in relation 
"to CCAI' scores (t(39) = 3.50, £ < .001). 

Approximately two week^ after administration of the CCAI, persuasive 
speeches were given in the introductory class (students had not received their 
persuasive speech assignment at the time the study was conducted). As 
indicated in Tables 1 and 2, even though the instructors used different speech 
rating forms and had no anchor points for their ratings, the persuasive speech 
grades correlated moderately with the CCAI at .51 (£ < .001) and with the 
speech section of the CCAI W « .40, £ < ,005). 

Elaboration ' 
Elaboration validation is the multi -trait aspect of the Campbell and 
Fiske (1959) model. In particular, it ascertains whether or not variables, or 
constructs not theoretically related to the construct are empirically related 
to each other. If they are not, discriminant validity is achieved. 

Past research has found that cognitive complexity is unrelated to 
communication competence and that verbal ability Is only slightly related to 
the CCAI* However, Identification of other constructs thought to be unrelated 
was somewhat difficult (Rubin & Henzl, 1981). No clear relationship between 
knowledge about communication and communication apprehension (motivation) In 
communication competence has b^en established in the past. Since knowledge, 
motivation and skill have been proposed as three constituent elements of 
competence (Spltzberg, 1983), It was anticipated that the relationships among 
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these three constructs would be moderate. Also, it was anticipated that the 
tendency to argue would not necessarily relate to -perceptions of competence. 

As shown in Table 1, the correlation between the CCAI and knowledge 
(average grade on the three exams given in class) was .52 < .001) and 
between the PRCA and the CCAI was -.37 (£ < .01). Little relationship 
existed between the PRCA and the average exam score (£ « .02, p « .44). Since, 
it appeared that perceptions of students' behaviors {>CCAJ scores) are related 
to their knowledge about communication and self-reported apprehension, the 
CCAI scores were regressed on knowledge and apprehension. As indicated in 
Table 4, the communication behavior of those students who were high in 
knowledge and low in apprehension behaved in a way that was evaluated more 
positively by the raters. The relatively weak correlation between the CCAI 
and the PRCA strengthens the conception that one Is only partially related t9 
the other. Behavior m^ not accurately reflect apprehension. When 
controlling for apprehension, the correlation between the CCAI and knowledge 
Increases only slightly { r « .57, £ < .001); and when controlling for 
knowledge, the correlation between the PRCA and the CCAI also Increases only 
slightly ( r = -.45, £ < .01). 



Insert Table 4 about here 

Further examination 'of the relationship between apprehension and 
knowledge was conducted by performing a median split on these variables, 
producing four groups: high Apprehensive/high knowledge, low 
apprehensive/high knowledge, high apprehensive/low knowledge, and low 
apprehensive/low knowledge. T^^-mean communication competence scores of these 
four groups were then compared. »^Table 5 reports a significant ANOVA where 

16 
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high knowledge/low apprehenslves scored si'gnificantly higher on the CCAI than ^ 

* • 

did low knowledge/high apprehensi ves (F(3,37)^ 3.05, £< .05). 



. j . Insert Table 5 about here 



Discussion . ♦ 

The goal of this study was to provide information on the validity of the 
CCAr as a procedure for assessing communi-cation competence in an educational 
setting. Conceptual ly,. the CCAI has been shown to be a valid Instrument. It 
appears to tap the variety of situations in which students communicate and the 
items In the instrument represent these situations. ^vdb». 
The method of operational Izing the construct, direct observation of 
- comrounication behavior, is clearly superior to self-report methods. The 
results Indicate that students generally do not' perceive their behaviors as 
others perceive them. When the goal of assessment is to ascertain how others 
actually view students* skills, the direct observation technique Is most 
appropriate. In fact, the .3Q^cpr relation between the CCSR and the. CCAI found 
in this Investigation may very wel 1 be a function of creating the sel f-report 
jneasure from the CCAI. Other self-report measures of behavior may not 
correlate as highly with the CCSR as the CCAI did. ' In particular, scales that 
combine behavioral Items with attltudinal or predisposltional items {such as 
that proposed by Wiemann, 1977) may show even less of a relationship. And 
since only 41 subjects were assessed in this Investigation, the relationship 
may be even more minimal. 

Past research has found the same Incongruence between self- and other- 
report data for different measures (Hewes, Haight, « Szalay, 1976; Norton. 
1978). However, Daly (1978) argues that self-reported behaviors are 
consistent with actual behavioral measures. The behavioral measure Daly used, 
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though, were actually of the self-report variety and would be expected to 
correlate with. self- report measures. ' 

One Interesting outcome of this study Is the posslbl 1 Ity that some people 
have more accurate perceptions of their behaviors than others. High self- 
monitors (I.e., those with a high correlation between CCSR and CCAI) may be 
able to analyze the outcome of tlieir actions and take the perspective of the 
other. As Snyder (1979) explains: 

The prototypic High Self- Monitoring Individual Is one who, out of' 
concern for the situational and Interpersonal appropriateness of 
his or her social behavior, is particularly sensitive to the 
expression and self-presentation of relevant others in social 
situations and uses these cues as guidelines for monitoring (that 



is, regulating and controlling) his or her own verbal and 
nonverbal self-presentation, (p. 89) ! 
Snyder's (1974) scale consists, of twenty-five statements concerning one's 
style of self-presentation. Research suggests that high self-monitors are 
more consistent in their judgments of their behaviors (Snyder, 1974, 1979; 
Turner, 1980), are better at influencing others and more verba j than low self- 
monitors (Oabbs, Evans, Hopp^ & Purvis, 1980), and are more accurate in their 



ratings (Turner, 1980). Follow-up research is now investigating the 
relationship between the self-monitoring scale and the self-report measure 
used here. 

Convergent validity also seems to have been established. Instructors' 
i^erceptions of students skills are borne out In the CCAI ratings. Use of the 
contrasting group method of establishing construct validity has shown that 
masters and non-masters of the skills are differentiated by use of the CCAI. 
Weiss (1982) previously found the same results; students' advisors -^ent those 
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who were thought to b« deficient in ^onwuni cation skills for CCAI testing, and 
all were found to be below average In CCAI skill level 5. 

Future research efforts in this area might Examine the speaking section 
of the College Outcome Measures ^Project (COMP) test (Forrest, 1979) in 
relation to the CCAI, TESOL-type interview. methods (Palmer, GVoot & Trosper, 
1981), tests of communication accuracy or effectiveness (see, e.g.,, Hale's 
1980 use of the tinker-toy test), listening tests (such as the STEP test), or 
interpersonal skills tests (Wiemann, 1^77). Only moderate relationships would 
be expected,, however, since the CCAI is a muUi-dimensional instrument that 
attempts to assess more than one skiy. The instrument provides a more 
comprehensive view or impression of the student's general ability to 
communicate and listen in interpersonal and public communication situations 
within the educational context. 

The attempt to establish discriminant validity was somewhat successful. 
The CCAI shows very little relationship to cognitive complexity and to 
argumentativeness, and. a slightly greater relationship to communication 
apprehension. As predispositional measures, -these indices seem to be 
assessing- something other than appropriateness of behavior in a particular 
situation. One interpretation^ight be that people do not always behave in 
ways that conform to their inclinations. Apprehensive individuals may not 
appear to be apprehensive* cognitively complex individuals may not use their 
constructs in taking others' perspectives, and argumentative indl vidua 1 s^ay 
not always behave in an argumentative manner. 

On the other hand, attributions of competence may be based on both 
observable and non-observable characteristics. Cronkhitg and Li ska (1980) 
express the same point of view in their conclusions- about impressions of 
source credlbil ity: 
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When one really begins to consider how much Information Is available on 
which to make judgments pf others. It Is easy to see we are not dealing 
with a process in which Impressions must be fabricated from fleeting 
snatches of experience. There Is no question that we sometimes do 
construct our views of others somewhat independently of what we actually 
observe, but It is aljso clear that that does not happen by default, 
(p. 113) 

The source credibility literature Is particularly pertinent to the study 
of conrounication competence. While competence and trustworthiness are often 
considered the main dimensions of credibility, perceptions of acceptability 
are often situation-bound. Cronkhite ^mdvjjiska's (1980) view of credibility 
mirrors the definition of competence proposed here, indicating that the same . 
sort of processes are used in these perceptions: 

The conceptualization we have in mind is one in which an Individual 
attributes certain unobservable characteristics to others on the basis of 
observed characteristics. The Individual then evaluctes the others by 
comparing these attributed characteristics to criteria for desirable 
^ communicators which have been derived from the needs/goals which are 
salient in the specific communication situation, (p. 105) ^ 
The study also demonstrates the role of knowledge and motivation in the 
act of behaving in a way that is judged as competent in a particular situa- 
tion. Since 1nferencel5 about knowledge and motivation are made when impres- " 
slons of competence are formed, it is reassuring to see that a relationship 
does exist. Still, measures of skill do not completely tap knowledge or 
motivation. Any impression of behavior will, to some degree, assess pred1s«- 
positions. The CCALis proposed as a valid and reliable method of assessing 
the behavioral aspect af communication competence; it assesses those skills , 
that are directly observable in the Impressions formed of students by others, 

20 : 
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ft 

Notes ^ 

1. Specifically, the four panel members independently determined: (1) that 
the items address'ed the appropriate knowledge base for the com|)etencies; (2) 
that the probes were clearly worded, %\\ey made clear the tasks to be 
performed, and they were free from extraneous material; (3) that the scenarios 
were realistic and appropriate for the competencies; (4) that the items had 
face validity; (5) that. the items did not contain any information or 
stereotypic depictions that could be seen as offensive to any racial, 
cultunil, sexual or religious group; (5) that the items did hot portray 
cultural, racial, sexual or religious groups. as unequal in ability or ^ 
endowment; (6) that the items did not contain clues or information that could 
be seen as working to the benefit or detriment of any racial, cuUural* sexual 
or religious group; and (7) that the Items contained no group-specific 
language or vocabulary. 
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FIGURE 1 

COMMUNICATION COMPETENCE SELF -REPORT (CCSR) SCALE ITEMS 
I mispronounce a lot of words. 

Whli^ speaking with someone, the words I use say one thing while my facefind^ 
tone of voice say Something different. ; 

When giving a speech. I speak clearly and distinctly. 

When giving a speech. I can be persuasive when I want to be. 

4«/hen I speak with others, my Ideas are clearly and concisely presented. 

When giving a speech, I thoroughly express and fully defend my positions on 
issues. 

I am unable to tell whether or not someone has understood what I have said. 

I know when I'm hearing a fact and when I'm hearing someone's personal 
^ opinion. 

When professors make suggestions in class on how I can improve, I understand 
the suggestions, 

I understand the assignments that are given orally in class. 

When I tell others about a class lecture I've heard, my version leaves out 
some important ^i terns. 

When I have to introduce myself in a class^ I am able to fuKly and concisely 
describe my interests and let others know who I am. 

When speaking with others, I have to ask a question several times, in several 
ways, to get the Information I want. 

I have to answer a question several times before others seem satisfied with my 
answer. 

I find it difficult to express my satisfaction or dissatisfaction about a 
course to the professor. 

When I explain something to someone, it tends to be disorganized. 

When I give directions to another person, the directions are accurate. 

When I try to describe someone else's point of view. I have trouble getting it 
right. 

I am able to give a balanced explanation of differing opinions. 



27 



Validity and Reliability 



25* 



TABLE 1 

PEARSON CORRELATES OF THE CCAI. CCSR, KNOWLEDGE AND PRCA 





CCAI 


1 

CCSR 


KNOWLEDGE 


PRCA 


) 

CCSR ' 


0.30* 




< 




KNOWLEDGE , 


0.52*** 


-0.07 






PRCA 


-0.37** 


-0.62*** 


0.02 




INSTRUCTOR 


0.65*** 


0.70*** 


0.65*** 


-0.24 


HOLISTIC 
PERS. SPEECH 


0.75*** 
0.51*** 


0.22 

/ 

^ 0.02 


, 0.49*** 
0.57*** 


-0.43** 

-b.i9 


ARGUMENTATIVE 
(N » 34) 


-0,02 


0.36* 


-0.20 


-0.39 



* £< . 05 **£< . 01 ***£< . 001 
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TABLE 2 

PEARSON CORRELATIONS FOR PUBLIC SPEAKING RATINGS 
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PUBLIC SPEAKING RATINGS 

INSTRiJCTOR'S 
HOLISTIC 

PERSUASIVE SPEECH^ 



CCAI SPEECH 

' 0.52*** 
0.62*** 
0.40** 



£<.05 



**£<.01 



'£<.C01 
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TABLE 3 

PEARSON CORRriATION OF CCAI & CCSR ITEMS 

f 

CCAI M CCSR M r 



Prnntmrl n^lnn 

r 1 vMUf IV 1 01 V 1 Uil 


A' 1 0 




1 f\ 

• 10 


r av 1 Q 1 wA|/i '^sa 1 vii/ lUiiu Ul fUlv6 


1 ftp 


0 CI 


• 11 




3.90 




♦ 17 


> 


O A\ 


3.o3 


.12 




o rn 


3.61 


.13 


ueicna a CApresa o rOint OT View 


O AC 


3.90 


• 27* 


Recoanize M1^undPr<t;inri1na 


"\ 71 


^5 7^ 


• 12 


Distlnaulsh Fact from Onlninn 








Understand Suaaestlons 




70 


"•UCJ 


Identify Class Ac^lanmpnt 

* iivfl 1^ wllXaV^ f^99tHl line 1 1 V 


17 


A on 


• CO 


Sunmarlze 




O • t3*T 


• Ix 


Introduce Self to Others 


4.07 


3.83 


-.27* 


Obtain Information 


3.71 


3.49 


^ .03 


Answer Questions 


3.63 


3.78 


-.03 


Express Feelings 


3 • S3 


3.66 


.05 


Organize Messages 


3.41 


3.37 


.18 


Give Directions 


2.66 


3.95 


.13 


Describe Another's Viewpoint 


3.29 


3.54 


-.01 


Describe Differences of Opinion 


2.73 


3.56 


.21 


* £ < .05 


(5 = 


high skin. 1 


« low skill) 
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TABLE 4 

MULTIPLE REGRESSION: KNOWLEDGE AND APPREHENSION AS 
PREDICTOJgg OF COWUNICATION COMPETENCE 



Knowledge . .53 4.30** 

Apprehension -.38 -3.08* 

F(2,38) « 13.67** 
Multiple R « .65** 
r2 « ,42 

* £ < .005 ** £ < .0001 
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TABLE 5 
MEAN COMPETENCE RATINGS 



KNOWLEDGE 

High Knowledge 
Low Knowledge 



MOTIVATION 

Low Apprehension High Apprehension 

f 



70.33* 
64.00 



68.50 
58.00* 



F (3,37) « 3.05, £ <^05 



Means with asterisks dfffWs^significantly 
using the Tukey-B procedurti (£ < .05) 
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